Counting Stationary Points of Random Landscapes as a 
Random Matrix Problem 

Yan V. Fyodorov 

School of Mathematical Sciences, University of Nottingham , Nottingham 
NG72RD, United Kingdom 

on leave from: Petersburg Nuclear Physics Institute RAS, 188350 Gatchina, 

Leningrad Reg., Russia 



Finding the mean of the total number Ntot of stationary points for 
A^— dimensional random Gaussian landscapes can be reduced to averaging 
the absolute value of characteristic polynomial of the corresponding Hes- 
sian. First such a reduction is illustrated for a class of models describing 
energy landscapes of elastic manifolds in random environment, and a gen- 
eral method of attacking the problem analytically is suggested. Then the 
exact solution to the problem^ for a class of landscapes corresponding 
to the simplest, yet nontrivial "toy model" with N degrees of freedom is 
described. For N ^ 1 our asymptotic analysis reveals a phase transition 
at some critical value fic of a control parameter fj, from a phase with finite 
landscape complexity: Ntot ^ e^^, < ^c) > to the phase with van- 
ishing complexity: > /Xc) = 0. This is interpreted as a transition to a 
glass-like state of the matter. 

PACS numbers: 05.40.-a, 75.10.Nr 

Characterising geometry of a complicated landscape is an important 
problem motivated by numerous applications in physics, image processing 
and other fields of applied mathematics [2|- The simplest, yet non-trivial 
task is to find the mean number of all stationary points (minima, maxima 
and saddles), which is a relevant question in statistical physics of disordered 
(glassy) systems [21 13 E] , and more recently in string theory jSj. 

Assuming that the landscape is described by a sufficiently smooth ran- 
dom function Ti. oi N real variables x = (xi, ...,X]sf) the problem amounts 
to finding all solutions of the simultaneous stationarity conditions dkTi. = 
for all k = 1,...,N, with 9^ standing for the partial derivative The 

total number N^l^^ of its stationary points in any spatial domain D is given 
by ^tot^ = Id p(^) c^^x, with p(x) being the corresponding density of the 
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stationary points. The ensemble-averaged value of such a density can be 
found according to the so-called Kac-Rice formula as 



where 5{x) stands for the Dirac's 5— function. 

Whenever the underlying physical problem necessitates to deal with an 
absolute value of the determinant, its presence considered to be a seri- 
ous technical challenge, see and references therein. In particular, an 
intensive work and controversy persists in calculating the so-called ther- 
modynamic complexity of the free energy for the standard Sherrington- 
Kirkpatrick model of spin glasses or its generalisations JP. Several heuris- 
tic schemes based on various versions of the replica trick were proposed in 
the literature recently to deal with the problem, see discussion and further 
references in 0. Despite some important insights, the present status of the 
methods is not yet completely satisfactory. On the other hand, keeping ab- 
solute value of the determinant is instrumental for dealing with the systems 
whose energy function displays many extrema in the configuration space. 
A famous example is the notorously difficult case of the random field Ising 
model, where disregarding the absolute value induces an additional symme- 
try leading to the so-called "dimensional reduction" prediction 112^, which 
proved to be wrong I3j. 

In this paper we are specifically addressing the problem of stationary 
point counting for energy functionals describing an elastic d— dimensional 
manifold embedded in a random media of + d dimensions, see Fig.l. 
This may serve either as as a model of domain walls in the random field 
Ising model ^1], or it is directly related to directed polymers in a random 
environment. 

In a discretized (lattice) version, the simplest form of the energy func- 
tional can be written as 



w = |5]x2 + ^ ^ (x,-x,)2 + ^y,[x,], /.>o,t>o. (2) 



Here the index i serves to number points in a d-dimensional lattice approx- 
imating the internal space of the elastic manifold, and the A— component 



manifold from its reference position Xj = at a given site of the lattice. 
The first term in Q is a parabolic confining potential serving to stabilize 
the reference plane Aj = 0, second term stands for the elastic energy in- 
teraction between the nearest neighbours in the lattice, and the last one is 
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parametrize transverse deviations of the 
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Fig. 1. Sketch of an elastic manifold for dimensions d=2, N=l. 



considered to be a random Gaussian function of both i and X, with zero 
mean and the variance specified by the pair correlation function chosen in 
the form: 



{Vi [X,] [X,]) = NVHi.f (^(X, - X,-)^) 



(3) 



where /(x) is any smooth function, with suitable decay at infinity. The 
stationarity conditions then amount to the set of simultaneous equations: 



dX 



dX} 



0, l = l,...,N (4) 



so that the mean total number of the stationary points of H amounts ac- 
cording to the Kac-Rice formula to 
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X (^1 det + ^KiAij + ^ ^^(^Og^fe) y I / 

In the above expression we introduced the matrix Ajj for a discrete Lapla- 
cian operator A corresponding to the underlying lattice and defined via: 



A. 
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and used that the first and the second derivatives of 1^[X] are (locahy) statis- 
tically independent due to Gaussian nature of the disorder, so that the two 
factors in the integrand can be averaged independently, which is an immense 
simplification. In fact, the averaging of the product of 5— functions in ((7|) is 
a rather straightforward task, using independence of the random potential 
in different lattice sites and its overall Gaussian nature. Moreover, the mean 
value of the modulus of the determinant is apparently independent of the 
coordinates xf^ which allows to perform the integration explicitly. After 
necessary manipulations, we arrive at an important intermediate expression 



To proceed further one should be able to calculate the ensemble average 
of the modulus of the characteristic determinant of a lattice Laplacian A 
perturbed by a kind of random potential. This problem in full generality 
is apparently rather difficult, and we will only discuss here a promising 
approach inspired by an analogy with the field of the Anderson localization 
of a quantum particle by static disorder. Indeed, in the latter field the 
problem of finding the ensemble average of products of one-particle Green's 
functions of the lattice operators with disorder was most successfully tackled 
in the framework of the so-called supersymmetry approach due to EfetovP^. 
see also a recent review article by Zirnbauer[TP. Following this analogy, we 
suggest a technique of evaluating the absolute value of the determinants for 
a real symmetric matrix fi + H via the following useful identitvpi II 7j: 



The two factors in the denominator of the right hand side of (jH)) can be 
represented in terms of the gaussian integrals absolutely convergent as long 
as e > 0. Further representing the determinantal factors in the numerator in 
terms of the Gaussian integral over anticommuting (Grassmann) variables 
we thus get a bona fide supersymmetric 15. object to be analysed. Actual 
implementation of this method is far from being trivial and we leave it as an 
interesting problem for future investigations. Nevertheless, it is important 
to stress that a possibility to perform the ensemble average explicitly exists 
whenever matrix entries of H are Gaussian-distributed. Similar strategy 
may be even employed when H is a stochastic differential operator with 
certain Gaussian part, as in the notorously difficult case of the random field 
Ising model ^21- For this reason it is natural to hope that the suggested 
method may appear of certain utility for a broad class of disordered models. 






^det {fi + ie + H) ^det {fi + ie + H) 
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In the rest of the present paper we discuss briefly an exphcit and rigorous 
sohition |lj of the counting problem for a simple, yet nontrivial limiting case 
of a "zero-dimensional" manifold (d=0) whose energy functional is of the 
form 



with a random Gaussian-distributed potential F(x) characterized by a par- 
ticular pair correlation function / as in ((31). This expression follows from 
((21) after neglecting the elastic coupling: t = 0, and as such just serves 
to describe behaviour of a single particle in a random potential. Despite 
seeming simplicity, the problem of studying this "toy model" [Tlj dynamics 
and thermodynamics is still rather non-trivial, with many features typical 
of complex, glassy systems. In particular, it is known to display a very 
nontrivial glassy behaviour at low enough temperatures - an unusual off- 
equilibrium relaxation dynamics attributed to a complex structure of the 
energy landscape. Although particular dynamical as well as statical proper- 
ties may differ substantially for different functions f{x) (e.g. "long-ranged" 
vs. "short-range" correlated potentials, see ^01), the very fact of glassy re- 
laxation is common to all of them. In fact, the same model admits an alter- 
native interpretation as a spin-glass, with Xi being looked at as "soft spins" 
in a quadratic well interacting via a random potential V^. From this point 
of view it is most interesting to concentrate on the limit of large number 
of "spins" ^ 1. The experience accumulated from working with various 
types of spin-glass modelsj^l suggests that for the energy landscape to be 
complex enough to induce a glassy behaviour the total number of stationary 
points NtotifJ') should grow exponentially with N as NtotifJ') ~ expA^S(;u). 
The quantity > in such a context is natural to call the landscape 

complexity. On the other hand, it is completely clear that the number of 
stationary points should tend to Ntot = 1 for very large /x when the random 
part is negligible in comparison with the deterministic one. In fact, when 
A^ — > oo we will find that a kind of sharp transition to the phase with van- 
ishing complexity occurs at some finite critical value /ic, so that = as 
long as /U > He, whereas > for /i < and tends to zero quadratically 
when jj, — > fic- Such a transition is just the glass transition observed earlier 
in a framework of a different approach in O El . 

For small = 1, 2 statistics of stationary points of ^ were investigated 
long ago in a classical study of specular light reflection from a random 
sea surface (31 and addressed several times ever since in various physical 
contexts, see (11(31. Let demonstrate that the case of arbitrary A^ can be 
very efficiently studied by reducing it to a problem typical for the well- 
developed theory of large random matrices 18 . Indeed, adopting formula 
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((7|) to the present case we see that the total number of stationary points in 
the whole space is given by: 

NM = \{\det{f,-H)\) (10) 

where —H stands for the matrix of second derivatives of the potential: 
Hk^k2 = df.^ i^^V. We see that the problem basically amounts to evaluating 
the ensemble average of the absolute value of the characteristic polynomial 
det(/u/Ar — H) (a.k.a. spectral determinant) of a particular random matrix 
H. statistical properties of the potential V result in the following second- 
order moments of the entries Hij = 1, N}: 

{HilHjm) = — [Sij6im + Simdij + Sudjm] (H) 

where we denoted = /"(O). This allows one to write down the density 
of the joint probability distribution (JPD) of the matrix H explicitly as 



ViH)dH oc dFexp [xr [h^) - {TiRf 



(12) 



where dH = ni<i<j<Ar dUij and the proportionality constant can be easily 
found from the normalisation condition and will be specified later on. It is 
evident that such a JPD is invariant with respect to rotations H — > 0~^H0 
by orthogonal matrices O G 0{N), but it is nevertheless different from 
the standard one typical for the so-called Gaussian Orthogonal Ensemble 
(GOE) 18 . However, introducing one extra Gaussian integration it is in 
fact straightforward to relate averaging over the JPD H12|) to that over the 
standard GOE. In particular, 

/OO Jf 2 

-=e-^- (I det [(^ + Jt) - Ho]\)aoE (13) 
'CO ■\/ ZTT 

where the averaging over Hq is performed with the GOE-type measure: 
dHoCNexv{-^TtH^}, with Cn = Nyy[{2TTjyN)^(^+'^y'^2^/^] being 
the relevant normalisation constant. 

To evaluate the ensemble averaging in H13() in the most economic way 
one can exploit explicitly the mentioned rotational 0(A^)— invariance and 
at the first step in a standard wavfTS] reduce the ensemble averaging to the 
integration over eigenvalues Ai, Xn of the matrix Hq. After a convenient 
rescaling Aj — > Jy'2/NXi the resulting expression acquires the following 
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form: 

{\det[ii, + Jt)-Ho]\)GOE (14) 

dXi... dXNY[\X^ - Xj\Y[\J N/2{m + t) - X^le'^^^ 
-~ •^-'^ i<j i=i 

where we denoted m = jj,/ J . One may notice that the above A^— fold integral 
can be further rewritten as a A'^ + 1 fold integral: 

ny „ /"OO /"OO 

e-i^+t) / dXi... dXN+i (15) 

J ~oo J—oo 
N+1 , s Af+1 

X n ^Nl2{m + t) - A^v+i ) H 1^* " ^il 

Such a representation makes it immediately evident that, in fact, the ex- 
pectation value of the modulus of the determinant in question is simply 
proportional to the mean spectral density i^Ar+i[m + 1] (a.k.a one-point cor- 
relation function I^y^^'^ ^/Nj2{m -1- t) , see jl8| ) of the same GOE matrix 
i^o but of enhanced size (TV -M) x (iV -M): 



(I det [(/u + Jt)lN - H^\\)goe ^ v^^^\{m + t)\ (16) 

1 

iV 



The last relation provides the complete solution of our original problem for 
any value of N, since the one-point function R^^^^^ [x] is known in a closed 
formjJH] for any value of N in terms of the Hermite polynomials Hk{x). 
Being interested mainly in extracting the complexity 

S(^) = hm N-^\nNM, 



we have to perform an asymptotic analysis of the mean eigenvalue density, 
and substitute the resulting expression into the integral ()13() . In the latter 
we can exploit the saddle-point method for asymptotic analysis. For < 
m < 1 the relevant saddle point istg = m satisfying < = ts+m < 2, and 
validating the use of the semicircular spectral density v[Xs\ = ^■\/4 — A^ in 
the calculation. This yields 

(I det (^/7v-^)|) ocef Vl-m2, 0<m<l (17) 
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For m > 1, however, it turns out that one has to use exponentially small 
("instanton") value for the spectral density: 



z^[A] oc exp < —N 



tAv^ 



In 



A > 2 



(18) 



where we only kept factors relevant for calculating the complexity in the 
limit of large N. The corresponding saddle-point value ts in the t— integral 
is given by the solution of the equation m = ^{Xs + y^Xj — 4) for the variable 
Xs = ts + m. The solution is easily found to be simply As = m + m^^ (note 
that As > 2 ensuring consistency of the procedure) which yields the resulting 
value for the modulus of the determinant to be given by 



(|det {^ilN - H)\) oce 



A'' Inm 



m > 1 



(19) 



Invoking our basic relation Ea. (|lU() for Ntot we see that the landscape com- 
plexity 5](^) of the random potential function ® is given by: 



S(/.) 
S(/.) 




ln(^/J), /X < /Xc = J 



> yUc = J 



(20) 
(21) 



Earlier works referred to the critical value fic = J as, on one hand, signalling 
the onset of a nontrivial glassy dynamics^Uj, and, on the other hand, corre- 
sponding to the point of a breakdown of the replica-symmetric solution [^1. 
Our calculation provides an independent support to the point of view at- 
tributing both phenomena to extensive number of stationary points in the 
energy landscape. At the critical value the complexity vanishes quadrati- 
cally: S(^ ^c) oc {^lc - M)^/Aic- 

The author is grateful to Steve Zelditch for bringing interesting ref- 
erence [H] to his attention. The work was supported by EPSRC grant 
EP/C515056/1 "Random Matrices and Polynomials: a tool to understand 
complexity" . 
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